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WHAT IS CLAIMED IS : 

Q^y ' . 1 1. A graphics and video controller comprising: 

2 an d ual aperture interface for receiving words 

3 of pixel data, each said word associated with an address 

4 buffer; 

5 circuitry for writing each said word of said 

6 pixel data received by said interface to a one of 

7 on-screen and off-screen memory areas of a frame buffer; 

8 circuitry for selectively retrieving said words 

9 from said on-screen and off -screen areas; ^Pca^K'CS 

10 a first pipeline for processing words of^ pix e^ 

11 data retrieved from said frame buffer; and 

12 i a second pipeline for processing words of 

13 - graphic -G data retrieved from said frame buffer. 

earlier 

2. The Loyotr enr of Claim 1 and further comprising 
output selection circuitry for selecting for output 
between graphics data received from said jii rst pi peline 
and data received from said second pipeline, said 
selection circuitry operable to: 

a first mode, pass data from sa id f\i rst 

pipelinej_j |jid 

in a second mode, pass data from said second 
pipeline when said data corresponds to a selected display 
position of a display window. 

1 3. The controller of Claim 2 wherein said 

2 selection circuitry is further operable to: 

3 in a third mode, pass data from said second 

4 pipeline when said data corresponds to said selected 

5 display position of said display window and data from 

6 said first pipeline match a color key. 
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1 4. The controller of Claim 3 wherein said 

2 selection circuitry is further operable in a fourth mode 

3 to pass data from said second pipeline when data from 

4 said first pipeline match a color key. 
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5. The controller of Claim 1 wherein said 
circuitry for retrieving maintains a stream of graphics 
data to said first pipeline and provides video data to 
sai d_ second pipeline when—a"^ dl^prta-y^raster scan reaches 
said di splay^ >osition Gj^^g^d^windo^^ ^ 

6. The controller of Claim 1 and further 
comprising : 

a video port for receiving real-time video 

data; and 

circuitry for generating an address to said 
memory at which said real-time video data is to be 
stored. 




7. The controller of Claim 1 wherein said second 
pipeline includes a first first-in-first-out memory for 
receiving data for a first display line of pixels in 
memory and a second first-in-first-out memory for 
receiving data from a second display line of pixels in 
memory . 

8. The controller of Claim 7 wherein said first 
display line ^adj acent in memory to said second display 
line . 

9. The controller of Claim 7 wherein said output 
selection circuitry comprises: 
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an output selector for selecting between data 
from said second pipeline and data from said first 
pipeline in response to a selection control signal; 

a register for maintaining a plurality of 
overlay control bits; 

window position control circuitry for 
selectively generating a position control signal when a 
word of said data stream from said second pipeline falls 
within a display window; 

color comparison circuitry for comparing words 
of said data stream from said first pipeline with a color 
key and p^ovffa^& ^jffi response a color comparison control 
signal; and 

a control selector for selectively providin 
id js-e lection control signal in response'" to said overlay 
control bits in said register and at least one of said 
position control and color comparison control signals. 

10. The 4HM=K t' lay — ' contro l — circuitry - of Claim 9 
wherein said window position control circuitry comprises: 

window position counters operable to increment 
from initial count values corresponding to a starting 
pixel of a display window as data representing each pixel 
in a display screen is pipelined through said overlay 
control circuitry; 

screen position counters operable to count as 
data representing each pixel in said display screen is 
pipelined through said overlay control circuitry; and 

comparison circuitry operable to compare a 
current count in said window position counters and a 
current count in said screen position counters and 
selectively generate said position control signal in 
response . 
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1 11. The Jvor^^r^^ontr rrj: — Cir cuit i? y- of Claim 9 

2 wherein said color comparison circuitry comprises: 

3 a color key register for storing bits composing 

4 said color key; and 

5 a plurality of AND-gates for comparing said 

6 words of said graphics data stream with bits of said 

7 color key. 

jr^^p / ^ A controller comprising: 

0~*~ L 2 \ a d ual " aperLure port for receiving video and 

3 graphics xiata, a word of said data received with an 

4 address directing said word to be processed as a word of 

5 video data o\a word of graphics data; 

6 a se&ond port for receiving real-time video 

7 data; \ 

8 circuitrv for generating an address associated 

9 with a selected one\pf said memory spaces for a word of 

10 said real-time video \iata; 

11 circuitry fo\ writing selectively each word of 

12 data into a selected o\e of on-screen and off-screen 

13 memory spaces of a frame Wiffer; 

14 circuitry for selectively retrieving said words 

15 of data from said on-screen afod off-screen spaces as data 

16 is rastered for driving a display; 

17 * a graphics backend pipeline for processing ones 

18 of said words of data representing graphics data 

19 retrieved from said frame buffer ;\ 

20 a video backend pipelineNfor processing other 

21 ones of said words of data representing video data 

22 retrieved from said frame buffer, s^id circuitry for 
' 23 retrieving always rastering a stream wVrds of data from 

24 said frame buffer to said graphics pipeline and 

25 rastering video data to said video backenu pipeline when 
2 6 a display raster scan reaches a display positiWi of a window; 

3T 




10-P20US 



PATENT 



35 




otvtput selector circuitry for selecting for 
output betweeri\words of data output from said graphics 
backend pipeline a<id words of data output from said video 
backend pipeline, 

The controller of Claim p£ wherein said output 
select or is further operable to select between graphics 
data output from a color look-up table and true color 
data output from said graphics pipeline. 
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The controller of Claim 13 wherein said output 
selector\is operable to: 

r n a first mode, pass only a word of data 
output from^qaid graphics pipeline; 

in av second mode, pass a word of data output 
from said video\pipeline when said display raster scan 
has reached a display position corresponding to a window 
and a word of data fYom said graphics pipeline otherwise; 

in a thirckmode, pass a word of data output 
from said video pipeline when said display raster scan 
has reached a display position corresponding to a window 
arid a corresponding wora, of data from said graphics 
pipeline matches a color ke\ and a word of data from said 
graphics pipeline otherwise ;\and 

in a fourth mode, pas>s a word of data from said 
video pipeline when said a corresponding word of data 
from said graphics pipeline matches a color key and a 
word of data from said graphics pipeline otherwise. 



The controller of Claim yi wherein said video 
pipeline includes a first first-in-first-out memory for 
receiving a plurality of words of data for a first 
display line of pixels in memory and a second 
first-in-first-out memory or receiving a plurality of 
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6 words of data from a second display line of pixels in 

7 memory. 

f 7 /(£> 

1/6? The controller of Claim j£ wherein said first 

display line is stored adjacent in memory to said second 

display line. 

1 lV The controller of Claim 12 wherein said output 

2 selectors, circuitry comprises: 

3 \a control selector having a plurality of data 

4 inputs coupled to a register, said register storing a 

5 plurality ofV>verlay control bits; 

6 winaow position control circuitry coupled to a 

7 first control ioput of said control selector, said window 

8 position control circuitry operable to selectively 

9 provide a first Vontrol signal to said first control 

10 input when a word V)f data being pipelined through said 

11 video pipeline fallk within a display window; 

12 color comparison circuitry operable to compare 

13 a word of data being\ pipelined through said graphics 

14 pipeline with a color \key and provide in response a 

15 second control signal to\a second control input of said 

16 control selector; and 

17 wherein said control selector is operable to 

18 provide "an output selection control signal to said 

19 control input of said output selector in response to at 

20 least one of said first and second control signals and 

21 said overlay control bits being stored in said register. 

1 18. The circuitry of Claim JS1 wherein said output 

2 . selector circuitry further includes b third input coupled 

3 to a second output of said graphics pipeline, said output 

4 selector further operable to select between data pipeline 

5 on said respective -video and graphics pipelines in 
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6 response tbs^bit presented at a second control input to 

7 said output selector. 

1 1/9. The circuitry of Claim 1/T wherein said window 

2 position control circuitry comprises: 

3 a window x-position counter operable to count 
< 4 from a loaded x-position value in response to a video 

\. 5 clock, said x-position counter reloading in response to^ 

\6/ display horizontal synchronization signal; 

7 ————— a window y-position counter operable to count 

8 from a loaded y-position value in response to said 

9 horizontal synchronization signal, said y-position 
10 counter reloading in response to a display vertical 

\ 11 synchronization signal; 

\12^ CRT position circuit r v^operable maintain counts 

13 corresponding to a current display pixel; and 

14 > comparison circuitry operable to compare 

15 current counts in said window counters with said current 

16 counts held in said CRT position circuitry and generate 

17 in response said first control signal. 

1 2*T. The circuitry of Claim Ltf wherein said window 

2 position control circuitry further comprises an x- 

3 position register for holding said x-position value for 

4 loading into said x-position counter and a y-position 

5 register for holding said y-position value for loading 

6 into said y-position counter. 

1 2a. The circuitry of Claim wherein said color 

2 comparison circuitry comprises: 

3 a color key register for storing a plurality of 

4 color key bits; and 

5 a plurality of XNOR-gates each having at least 

6 one input coupled to a bit position in said color key 
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7 register and at least one input coupled to said graphics 

8 data path. 

1 ^ / 2$. The circuitry of Claim L£ wherein said video 

2 pipeline comprises: 

3 a first-in/first-out memory for receiving a 

4 first stream of words of data from said frame buffer; 

5 a second f irst-in/f ir'st-out memory disposed in 

6 parallel with said first first-in/first-out memory for 

7 receiving a second stream of words of data from said 

8 frame buffer; and 

9 interpolation circuitry for selectively 

0 generating an additional word of data by interpolating a 

1 word of said first stream and a word of second stream 

2 data output from said first and second first-in/first-out 

3 memories. 



P3510-P20US PATENT 

39 

1 ^<f. A display system comprising: 

2 a first backend pipeline for processing 

3 pj^nyhnrk vMpo data; 

4 a second backend pipeline for processing 

5 graphics data disposed in parallel to said first 

6 processing pipeline; 

7 a multi-format frame buffer memory having 

8 on-screen and off-screen areas each operable to 

9 simultaneously store data in graphics and video formats; 
O-^ 10 a dual -ap e rtur e input port for receiving both 

11 graphics and * video data, each word of said data 

12 associated with an address directing said word to be 

13 processed as either graphics or video data; 

14 circuitry for writing a word of said playback 

15 data into a selected one of said areas of said 

16 multi-format memory; 

17 memory control circuitry for controlling the 

18 transfer of data between said first backend pipeline and 

19 said frame buffer and between said second backend 

20 pipeline and said frame buffer; 

21 a display unit; and 

22 overlay control circuitry for selecting for 

23 output to said display unit between data provided by said 

24 first backend pipeline and data provided by said second 

\25 backend pipeline. 

1 2A - The display system of Claim Z3T wherein said 

2 second backend pipeline includes: 

V} . a first f irst-in-f irst-out memory for receiving 

\J first selecte d data; 

5 "a second first-in-first-out memory disposed in 

6 parallel to said first first:^in-f irst-out memory for 

7 receiving second selecteil data ^ ) 
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8 interpolation data for generating additional 

9 data by interpolating data output from said respective 

0 first and second first-in-first-out memories. 

1 J? 2% . The display system of Claim 2< wherein said 

2 second backend pipeline further comprises color 

3 conversion circuitry for converting data received from 

4 said frame buffer in a video format to a graphics format. 

^ 26 . The display system of Claim 23^ .aggi ^f urther 

2 comprising a video front-end pipeline for inputting video 

3 data into a selected one of on-screen and off-screen 

4 spaces of said frame buffer comprising: 

5 a video data port for receiving video data from 

6 a real time data source; / 

7 input control circuitry for receiving framing 

8 signals associated with said real time data and 

9 generating corresponding addresses to said selected one 

0 of said spaces in response. 

2V. The display system of Claim wherein said 

video front-end pipeline further comprises encoding 
circuitry for packiry^said video data prior to storage in 
said selected one spaces. 

1 Z8T. The display system of Claim 2$T wherein said 

2 video front-end pipeline further comprisi ng m ultiplexing 

3 circuitry for selecting between video data received 

4 through said video data port and data received from said^ 

5 dual aperture port. ^ » 

1 The display system of Claim 2# wherein said 

2 video front end pipeline further comprises conversion 

3 circuitry for converting graphics data received through 
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4 said dual-aperture port to a video format for storage in 

5 said selected one of said spaces. 
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A display data processing system comprising: 
2 circuitry for writing data into an on-screen 

" „ 3 space of a frame buffer; 

4 circuitry for writing data into an off-screen 

5 space of said frame buffer; 

6 a video pipeline for processing data output 

7 from - ea - rd a selected one of said on-screen and off-screen 

8 spaces comprising: 

9 a first first-in-first-out memory for 

10 receiving selected data from said selected space; 

11 a second first-in-first-out memory 

12 disposed in parallel to said first f irst-in-f irst- 

13 out memory for receiving other selected data from 

14 said selected space; and 

15 an interpolator for generating additional 

16 data by interpolating data output from said 

17 respective first and second first-in-first-out 

18 memories ; 

19 a graphics pipeline disposed in parallel to 

20 said video pipeline for processing data output from a 

21 selected one of said on-screen and off-screen spaces; and 

22 an output selector for selecting between data 

23 output from said video pipeline and data output from said 

\24 graphics pipeline. 

XL/ ^^C. The system of Claim and further c omprising 

2 selection control circuitry for generating an output 

3 control signal for controlling said output selector 

4 comprising : 

5 a control selector having a plurality of data 

6 inputs coupled to a register, said register for storing 

7 a plurality of overlay control bits; and 

8 color comparison circuitry operable to compare 

9 bits of data output from said graphics pipeline with a 

n 
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color key and provide in response a control signal to a 
control input of said control selector. 



The system of C 



if 

laim p<Tj 



and^f urth er comprising 
window position control circuitry operable to provide a 
second control signal to a second control input of said 
control selector when data from said video pipeline falls 
within a display window. 
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